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Abstract 

In this paper, we study Nash equilibrium payoffs for two-player nonzero-sum stochastic 
differential games via the theory of backward stochastic differential equations. We obtain an 
existence theorem and a characterization theorem of Nash equilibrium payoffs for two-player 
nonzero-sum stochastic differential games with nonlinear cost functionals defined with the 
help of a doubly controlled backward stochastic differential equation. Our results extend for- 
mer ones by Buckdahn, Cardaliaguet and Rainer [3] and are based on a backward stochastic 
differential equation approach. 

Keywords: Nash equilibrium; stochastic differential games; backward stochastic differential 
equations; stochastic backward semigroups. 

1 Introduction 

Since the pioneering work of Isaacs [11], differential games and stochastic differential games have 
been investigated by many authors. Fleming and Souganidis [7] were the first to study zero- 
sum stochastic differential games and obtained that the lower and the upper value functions of 
such games satisfy the dynamic programming principle and coincide under the Isaacs condition. 
Recently basing on the ideas of Fleming and Souganidis [7], Buckdahn, Cardaliaguet and Rainer 
[3] studied Nash equilibrium payoffs for two-player nonzero-sum stochastic differential games, 
while Buckdahn and Li [4] generalized at one hand the results of Fleming and Souganidis [7] 
for stochastic differential games and simplified the approach considerably by using backward 
stochastic differential equations. We refer the reader to Fleming and Souganidis [7] and Friedman 
[8] for a description of earlier results. In the present paper we bring ideas of the both papers 
[3] and [4] together, in order to study Nash equilibrium payoffs for two-player nonzero-sum 
stochastic differential games with nonlinear cost functionals. 

As concerns deterministic differential games, since the work of Kononenko [13] in the frame- 
work of positional stategies and Tolwinski, Haurie and Leitmann [19] in the framework of Fried- 
man strategies, it is well known that deterministic nonzero-sum differential games admit Nash 
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equilibrium payoffs. Recently, Buckdahn, Cardaliaguet and Rainer [3] generalized the above 
result to two-player nonzero-sum stochastic differential games and obtained an existence and a 
characterization for two-player nonzero-sum stochastic differential games. On the other hand, 
since the works of Case [5] and Friedman [8], Nash equilibrium payoffs should be the solution 
of Hamilton-Jacobi equations. Basing on these ideas, Bessoussan and Frehse [1] and Mannucci 
[15] generalized the above result to stochastic differential games using the existence of smooth 
enough solutions for a system of parabolic partial differential equations, while Hamadene, Lep- 
eltier and Peng [9], Hamadene [10] and Lepeltier, Wu and Yu [14] used a saddle point argument 
in the framework of backward stochastic differential equations. But both methods rely heavily 
on the assumption of the non degeneracy of diffusion coefficients. 

In this paper, we investigate Nash equilibrium payoffs for two-player nonzero-sum stochastic 
differential games. The generalization of earlier result by Buckdahn, Cardaliaguet and Rainer [3] 
concerns the following aspects: Firstly, our cost functionals are defined by controlled backward 
stochastic differential equations, and the admissible control processes depend on events occurring 
before the beginning of the stochastic differential game. Thus, our cost functionals are not 
necessarily deterministic. Secondly, since our cost functionals are nonlinear, we cannot apply 
the methods used in Buckdahn, Cardaliaguet and Rainer [3]. We make use of the notion of 
stochastic backward semigroups introduced by Peng [17], and the theory of backward stochastic 
differential equations. Finally, each player has his own backward stochastic differential equation, 
controlled also by the adversary player, which defines his own cost functional. 

Beyond the theoretical interest of this paper the result of the paper is also applicable in 
finance and economics. For instance, we can consider an application of our theoretical result to 
a problem arising in financial markets. Let the financial market consist of a risk-free asset and 
risky stocks and consider two investors (players) in this financial market. Both investors try to 
maximize their payoff functionals, which are, in general, different. To maximize them, they have 
to use investment strategies with delays. Indeed, although both investors react immediately 
to the financial market, the financial market is not so quick in reacting to the moves of both 
investors. The above described problem leads to a two-player nonzero-sum stochastic differential 
game. We can use our theoretical result to get an existence theorem and a characterization 
theorem of Nash equilibrium payoffs for this game. 

Our paper is organized as follows. In Section 2, we introduce some notations and preliminar- 
ies concerning backward stochastic differential equations, which we will need in what follows. In 
Section 3, we give the main results of this paper and their proofs, i.e., an existence theorem and 
a characterization theorem of Nash equilibrium payoffs for two-player nonzero-sum stochastic 
differential games as well as their proofs. 

2 Preliminaries 

Let (fi, J-, P) be the classical Wiener space, i.e., for the given terminal time T > 0, we consider 
Q = C ([0,T];R d ) as the space of continuous functions h : [0,T] -)■ R d such that h(0) = 0, 
endowed with the supremum norm, and let P be the Wiener measure on the Borel cr-field B(fl) 
over Cl, with respect to which the coordinate process B t {oj) = u t ,uj £ £l,t G [0, T], is a d- 
dimensional standard Brownian motion. We denote by A/p the collection of all P-null sets in Q 
and define the filtration F = {^"tjtefo^]) which is generated by the coordinate process B and 
completed by all P-null sets: 

T t = a{B s ,s<t}\/N F , te [0,T], 
where A/p is the set of all P-null sets. 
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Let us introduce the following spaces, which will be needed in what follows. 



is an J^-measurable random variable such that 

E[iei 2 ] < +oo|, 

• % 2 (0, T; R d ) = \ ip j </? : Vt x [0, T] — » R d is an {Ji}-adapted process such that 



• S 2 (0, T; R) = < 99 I 93 : x [0, T] — > R is an {J^j-adapted continuous process such that 



Here / : x [0, T] x R x R d — > R is such that, for any (y, z) G R x R d , /(•, y, z) is progressively 
measurable. We make the following assumptions: 

(HI) (Lipschitz condition): There exists a positive constant L such that for all (t,yi,Zi) G 
[0,T] x R x R d , i = 1,2, 

- f(t,y 2 ,z 2 )\ < L(\yi - y 2 \ + |zi - z 2 |). 

(H2) /(-,0,0) e« 2 (0,T;R). 

The following existence and uniqueness theorem was established by Pardoux and Peng [16]. 

Lemma 2.1 Let the assumptions (HI) and (H2) hold. Then, for alii G L 2 (n, T T , P; R), 
(^.ij has a unique solution 

(Y,Z) G S 2 (0,T;R) x ^ 2 (0,T;R d ). 

We recall the well-known comparison theorem for solutions of BSDEs, which has been es- 
tablished by El Karoui, Peng and Quenez [6] and Peng [17]. 

Lemma 2.2 Let f\f 2 G L 2 (S1, P; R), and f 1 and f 2 satisfy (HI) and (H2). We denote by 
(y 1 ,^ 1 ) and (Y 2 ,Z 2 ) the solutions of BSDEs with data (/ , f 1 ) and (f 2 ,^ 2 ), respectively, and 
we suppose that 

(i)e <e, p-a.5., 

(iij fHt,Y 2 ,Z 2 ) < f 2 (t,Y 2 ,Z 2 ), dtdF-a.e. 
Then, we have < Y t 2 , a.s., /or f G [0,T]. Moreover, zf P(f 1 < f 2 ) > 0, tfien P(y i 1 < 
Y t 2 ) > 0,t G [0, T], and in particular, Yq < Y Q 2 . 





We consider the BSDE with data (/, f ) : 




< t < T. 



(2.1) 
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By virtue of the notations introduced in the above Lemma, for some / : flx[0,T]xKxl' i — >• 
R, we put 

f(s, y, z) = f(s, y, z) + v?i(s), f 2 (s, y, z) = f(s, y, z) + <p 2 (s). 

Then we have the following lemma. For the proof the readers can refer to El Karoui, Peng and 
Quenez [6], and Peng [17]. 

Lemma 2.3 Suppose that S, 1 ,^ 2 € L 2 (Q, Tt, P)> f satisfies (HI) and (H2) and (pi,<f2 £ 
H 2 (0,T;R). We denote by (T 1 ,^ 1 ) and (Y 2 ,Z 2 ) the solution of BSDEs (2.1) with data (f 1 ,^ 1 ) 
and (f 2 ,£ 2 ), respectively. Then we have the following estimate: 

\Y t l ~ Y 2 \ 2 + ±E { jT e^[\Y} ~ Y 2 \ 2 + \Z\ - Z 2 \ 2 ]ds | F t } 



where ft = 16(1 + L 2 ) and L is the Lipschitz constant in (HI). 



3 Nash equilibrium payoffs for nonzero-sum stochastic differen- 
tial games 

The objective of this section is to investigate Nash equilibrium payoffs for two-player nonzero- 
sum stochastic differential games with nonlinear cost functionals. An existence theorem (The- 
orem 3.20) and a characterization theorem (Theorem 3.16) of Nash equilibrium payoffs for 
two-player nonzero-sum stochastic differential games are the main results of this section. 

Let U and V be two compact metric spaces. Here U is considered as the control state space 
of the first player, and V as that of the second one. The associated sets of admissible controls 
will be denoted by U and V, respectively. The set U is formed by all [/-valued F-progressively 
measurable processes, and V is the set of all ^-valued F-progressively measurable processes. 

For given admissible controls u(-) € U and v(-) € V, we consider the following control system 

b(s,X t s ,<:,u,v ,u s ,v s )ds + a(s,Xi ,<:,u,v ,u s ,v s )dB s , s € [t,T], 

(3.1) 

c, 

where t € [0, T] is regarded as the initial time, and C £ L 2 (£l, J-~t, P; M n ) as the initial state. The 
mappings 

b:[0,T}xR n xUxV^R n , a : [0, T] x M n x U x V -> R nxd 
are supposed to satisfy the following conditions: 

(H3.1) For all x € M. n , 6(-,x, •,•) and cr(-,x, •, •) are continuous in (t,u,v); 
(H3.2) There exists a positive constant L such that, for all t £ [0,T],x,x' S M n , u € U,v S V, 
\b(t, x, u, v) — b(t, x' , u,v)\ + \cr(t, x, u, v) — a(t, x' , u,v)\ < L\x — x |. 



dX, 



X 



t 



It is obvious that, under the above conditions, for any u(-) € IA and v (■) G V, the control system 
(3.1) has a unique strong solution {X 1 ^' 11 ^ , < t < s < T}, and we also have the following 
estimates. 
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Lemma 3.1 For all p > 2, there exists a positive constant C p such that, for all t G [0,T], 
CC' 6 L 2 {n,F t ,F;R n ), «(•) G U and «(•) € V, 

El sup 1 < C p (l + |C| P ), F-a.s., 

[t<s<T J 

E J sup IX 1 /'^ - X t /'> u ^ v \ p F t \ < C p \( - CT, P - a.s. 

\t<s<T 

Here the constant C p only depends on p, the Lipschitz constant and the linear growth of b and 
a. 

For given admissible controls u(-) G U and v(-) G V, we consider the following BSDE: 



(3.2) 



T 

Zp^dBr, t<s<T, 

where X t, ^' ,u,v is introduced in equation (3.1) and 

$ = $(x) : R n -> R, / = f(t, x, y, z, u, v) : [0, T] x R™ x R x R d x U x V -> R 
satisfy the following conditions: 

(113.3) For all (x, y, z) G R n x R x R d , /(•, x, y, z, •, •) is continuous in (t, u, v); 

(H3A) There exists a positive constant L such that, for all t G [0,T],x,x' G R n , y, y' G R, 
z, z' G R d , u £ U and »£7, 

|/(t,x,y,z,u,?;) - f(t,x',y',z',u,v)\ + |$(x) - $(x')| 
<L(|x-x'| + |y-y'| + |z-z'|). 

It is by now standard that under the above assumptions equation (3.2) admits a unique solution 
(yt,C;«,« j £*,Cw) e 5 2 (o,T;R) x % 2 (0, T; R d ). Moreover, in Buckdahn and Li [4] it was shown 
that the following holds: 

Proposition 3.2 There exists a positive constant C such that, for all t G [0, T], u(-) G IA and 

|y/^|<C(l + |C|), P-a. S ., 
ijrt.Ciu.t; _ Y t,(';u,v\ < _ ^ p _ a _ s _ 

We now introduce subspaces of admissible controls and give the definition of admissible 
strategies. 

Definition 3.3 The space Ut,T (resp. Vtr) of admissible controls for Player I (resp., II) on 
the interval [t,T] is defined as the space of all processes {u r } r e[t,T} (resp., {v r }re[t,T\ ), which are 
¥ -progressively measurable and take values in U (resp., V). 
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Definition 3.4 A nonanticipating strategy with delay (NAD strategy) for Player I is a measur- 
able mapping a : Vt,T — > Ut,T> which satisfies the following properties: 

1) a is a nonanticipative strategy, i.e., for every ¥ -stopping time r : VL —¥ [t, T], and for 
v±,V2 G Vt,T with v\ = V2 on [[t,r]] } it holds a(v{) = a{v2) on [[t, t]]. (Recall that [[t,r]] = 
{(s,oj) e[t,T]xQ,t<s< t(u)}). 

2) a is a nonanticipative strategy with delay, i.e., for all v G Vt,T, there exists an increasing 
sequence of stopping times {S n (v)} n >\ with 

i) t = S (v) < Si{v) < ■ ■ ■< S n (v) < ■ ■ ■ < T, 

ii) S n (v) < S n+ i(v) on {S n (v) <T},n> 0, 
™) Wn>l{Sn(v) = T}) = 1, 

such that, for alln > 1, A € Ft and v,v' G Vt,T, we have: if v = v' on [[t, S n -i(v)]] f](A x [t,T]), 
then 

iv) Si(v) = Si(v'), on A, F-a.s., 1 < I < n, 

v) a(v) = a(v'), on [[t, S n (v)]} f)(A X [t, T]). 

The set of all NAD strategies for Player I for games over the time interval [t,T] is denoted 
by At,T- The set of all NAD strategies /3 : Ut,T Vt,T f or Player II for games over the time 
interval [t,T] is defined symmetrically and denoted by Bt,T- 

We have the following lemma, which is useful in what follows. 

Lemma 3.5 Let a G At,T and [3 G S^t- Then there exists a unique couple of admissible control 
processes (u, v) G Ut,T x Vt,T such that 

a{v) = u, (3(u) = v. 

Such a result can be found already in [3]. However, since our definition of NAD strategies differs, 
we shall provide its proof. 

For given control processes u(-) G Ut,T and v (•) G Vt,T, we introduce now the associated cost 
functional 

J(t,x;u,v) := yi' w | s=4 , (t,x) G [0,T] x R n . 

(Recall that Y t < x > u > v is defined by BSDE (3.2) with ( = x G R n ). We define the lower and the 
upper value functions W and U, resp., of the game: For all (t, x) G [0, T] x M n , we put 

W(t, x) := esssup essinf J(t, x; a, /?), 

and 

U (t, x) := essinf esssup J(t, x; a, (3). 

Here we use Lemma 3.5 to identify (X t,x ' a 'P, Y*'®' 01 '^, Z t ' x ' a '^) = (X t ' x ' v " v , Y t > x '< u ' v , Z t ' x ' u ' v ), and, 
in particular, J(t, x; a, /3) = J(t, x;u,v), where (u,v) G Ut,T x V^t is the couple of controls 
associated with (a, 0) G At,T x Bt,T by the relation (a(v), f3(u)) = (u,v). 

Remark 3.6 For the convenience of the reader we recall the notion of the essential infimum 
and the essential supremum of families of random variables (see, e.g., Karatzas and Shreve [12] 
for more details). Given a family of F -measurable real valued random variables £ Q (a G I), an 
F -measurable random variable £ is said to be essinf ag /£ Q; if 
(i) £ < £ Q , P — a.s., for all a G I; 
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(ii) if for any random variable 7] such that n < £ a , P-a.s., for all a G /, it holds that 77 < £, 
F-a.s. 

We introduce notion of esssup Qg j £ Q by the following relation: 

esssup£ Q = — essinf(— 
aei a&1 

Remark 3.7 Lemma 3.5 guarantees that for NAD strategies a G At t T and P G BtT there exists 
a unique associate couple (u, v) G Ut,T x Vt,T of admissible controls such that a(v) = u, j3{u) = v. 
For general nonanticipative strategies we can, in general, not get such a couple of controls. Let 
us give an example: We suppose that U = V and <p,ip : U — > U are measurable functions such 
that if; o ip doesn't have a fixed point. We define 

a(v) s = cp(v s ),s E[t,T],v E V t ,T, 
(3(u) s = ip(u s ),s G [t,T],u G U t ,T- 

Then a and /3 are nonanticipative strategies for Player I and LI, respectively. But there is no 
couple (u,v) G Ut,T x Vt,T such that a(v) = u,/3(u) = v. Indeed, if there existed such couple of 
controls (u,v) G Ut,T x Vt,T, we would have, for s G [t,T], 

u s = a(v) s = ip(v s ), 
v s = P(u) s = ip{u s ) =ipo ip{v s ). 

But this means that v s is a fixed point of V' '/?, which contradicts the assumptions of the absence 
of fixed points. 

Let us now give the proof of Lemma 3.5. 

Proof: We give the proof in two steps. 

Step 1: For (u, v) G £Yt,T x Vt,T we denote by {S n (v )} n >i (resp. {T n (u)} n >i) the sequence of 
stopping times associated with a G At,T (resp. (3 G #j,t) by Definition 3.4. Then, for arbitrarily 
given (u, v) G Ut^r x Vt,T we define the optional set 

r== (J (MUM), 

n>l 

where [5 n (u)] (resp. [T n (u)]) denotes the graph of S n (v) (resp. T n {u)). Then, for ui G ft, we 
have 

]» = ^S n (v)(u),Ti(u)(u}) in ,l > l,s.t. S n (v)(cj) <T,Ti(u)(u) <t}(J{T}, 

and we observe that T(co) is a finite set. 

We denote by Z?p the first hitting time of T, and we define a sequence of {7>}-stopping times 
as follows: 

to = t, 
n (u,v) = Dr(= S\(v) A T\(u)), 
t 2 (u,v) = D r \ [Tl{UiV)] AT, 

r n (u, v) = D rXu n-i [T . {UtV)] A T, n > 1. 
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Recall that a A b = min{a, b}, a, b G R. 

We notice that ri(u, v) is independent of (u,v), and for n > 2, T n (u,v) depends only on 
(. u i v )\[[t,T n -i(u,v)]]- Indeed, this is a direct consequence of point 2) in Definition 3.4 and the 
definition of {r n (u, v )} n >i- 

From the definition of {r n } n >i it follows that, for all (u, v) G Ut,T x VtT, 

i) t = to < T\(u, v) < ■ ■ ■ < T n (u, v) < ■ ■ ■ < T, 

ii) r n (u,v) < T n+ i(u,v), on {r n (u, v) < T},n > 0. Moreover, since T(uj) is a finite set, 
P(dw) - a.s., P(U„>iK(«, v) = T}) = 1. 

iii) For n > 1 and all (u, v), (u' , v') G U ti T x V^t, it holds: if (ii, u) = (u', v') on [[i, r n _!(u, v)]], 
then ti(u,v) = ti(u',v'), 1 < I < n, and a(v) = a(v') and /3(/u) = f3(u'), on [[i, r n (w, v)]}. 

Step 2: For a G ^4t,T and /3 G £>t,T, we let {r„} n >i be constructed as above. Since neither 
r\ depends on the controls nor (a, j3) restricted to [[t, ti}] does, the process 

(u°,v°) := (a(v ),P(u )), for arbitrary (u ,v ) G U t ,T x V^t, 

is such that a(i>°) = u° and (3(u°) = v°, on [[i, ti]]. 

Taking into account that only depends on the controls restricted to [[t, t\]], and (a(v°), (3(u )) 
\[[t,T 2 (u ,v )]] onr y depends on the controls (u°,v°) restricted to [[t, n]], we can define 

(«V)== (a( V °),/3(n )), 

and since we have (u 1 ,^ 1 ) = (u°,u°) on on [[i,Ti]], it follows that (it 1 ,?; 1 ) = (a(v 1 ), /^(m 1 )), on 
[[£, T2(ti 1 , u 1 )]]. Repeating the above argument we put 

(u n ,v n ) := (a(u n - 1 ), / 8(« n - 1 )) G W t , T x V t)T . 

Then, since due to (n-l)th iteration step (a(/u /3(« n_1 )) = (u n_1 , on [[t, r n (n n_1 , w"" 1 )]], 

we also have (u 11 " 1 ,!) 11 " 1 ) = (u n ,v n ), on [[t, r n (ii n_1 , u"" 1 )]], and, thus, also Ti(u n ,v n ) = 
T l (u n -\v n - 1 ), < / < n + 1. Hence, 

ty^-V" 1 ) = r n (u n ,v n ) < r n+1 (u n ,v n ) = r n+1 (u n+ \ v n+1 ), n > 1, 

from which we deduce the existence of the limit of stopping times 

T := lim T n (u n ,v n ) < T. 

n~ s-oo 

For arbitrarily given (uq,vq) G Ut,T x Vt,T we define 

:= ^(u n ,U n )l[[ rn _ 1 ( u n-l il) n-l) irn ( M n )1 ,n)[[ + (li , «o) 1 [[r,T]] • 

n>0 

Obviously, (u,v) G Z^t x V^t, and since (u,v) = (u n ,v n ) on [[t, T n (u n , v n )]], we have ti(u,v) = 
Ti(u n ,v n ), < I < n + 1, n > (see the above property iii)). But this allows to conclude from 
ii) that 

P( |J {r n (u n , v n ) = T}) = P( (J {r n (u, t,) = T}) = 1. 

n>l n>l 

Consequently, since the above defined process (n, v) G ^t,T x Vt,T has the property that 
(a(v),(3(u)) = (a(v n ), /3(u n )) on [[t,T n (u,v)]\ (nonanticipativity of (a, (5)) 
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= (u n ,v n ) = (u,v) on [[t,T n (u,v)]\, 
we have (a(v), f3(u)) = (u,v) on [t,T] x Cl,dsdF — a.e. The proof is complete. □ 

The following lemmas were established in [2] under a slightly different definition of NAD 
strategies. However, their validity in our new framework can be checked easily. 

Lemma 3.8 Under assumptions (H3.1)-(H3.4), for all (t,x) G [0, T] x R n , the value functions 
W(t, x) and U(t, x) are deterministic functions. 

Lemma 3.9 There exists a positive constant C such that, for all t,t' G [0, T] and x,x' G M n , 
we have 

(i) W(t,x) is ^-Holder continuous in t: 

\W(t,x) - W{t',x)\ < C(l + \x\)\t - t'fi; 

(ii) \W(t,x)-W(t,x')\<C\x-x'\. 
The same properties hold true for the function U. 

Remark 3.10 From the above Lemma it follows, in particular, that the functions W and U are 
of at most linear growth, i.e., there exists a positive constant C such that, for all t G [0, T] and 
x G R n , \W(t,x)\ < (7(1 + \x\). 

We now recall the notion of stochastic backward semigroups, which was introduced by Peng 
[17] and translated by Buckdahn and Li [4] into the framework of stochastic differential games. 
For a given initial condition (t, x), a positive number 5 <T — t, for admissible control processes 
u(-) G Ut,t+8 an d v(-) G Vt,t+Si an d a real-valued random variable rj G L 2 (Q, T t +s, F; F), we 
define 

G it+5 iVl ■= Y t 

£ X'U V 1 X ' U V 

where (YJ ' ' , ZJ ' ' )t< s <t+6 is the unique solution of the following BSDE with time horizon 
t + 5: 



.t+5 

Y; w = v+ f(r,Xl' x ' u ' v ,Y; x ' u '\z; x;u ' v ,u r ,v r )dr 
t+5 

z; x ' u,v dB r , t<s<t + 5, 

and X ' x ' u ' v is the unique solution of equation (3.1) with £ = x G M n . 

We observe that for the solution Y*.*;«.« of BSDE (3.2) with ( = x G R n we have 

J(t,x;u,v) = Y t ' G t y [&{Xj )} = G t ' )t ^ [Y t ^ ] 

Remark 3.11 For the special case that f is independent of (y,z) we have 

Gt,x;u,vr^ / v t,x;u,v\i ^tt,x;u,v r-irt,x;u,v\ 

s,T i 9 \ A T )\ ~ G s,t+5 i Y t+5 \ 

ft+5 

= E[Y t %Y' v + j f{r,Xl^,u r ,v r )dr JF S ], s G [t,t + 6}. 
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In particular. 



r T 

Gl'^ v MX t /' u ' v )] = E[^(X t 1 i x ' u ' v ) + J f{r,Xl^ u ' v ,u r ,v r )dr 



Ft}. 



For more details on stochastic backward semigroups the reader is referred to Peng [17] and 
Buckdahn and Li [4]. Let us also recall the following dynamic programming principle for the 
value functions of stochastic differential games. Its proof can be found in [2]. 

Proposition 3.12 Under the assumptions (H3.1)-(H3.4) the following dynamic programming 
principle holds: for all < 5 <T — t, x G R n , 

W(t,x) = esssup essinf G^f[W(t + 5, X%> a 

and 

U(t,x) = essinf esssup G*'^ ,/3 [?7(t + 5, Xj^ a '^)]. 

After having recalled some basics on two-player zero-sum stochastic differential games, let us 
introduce the framework of two-player nonzero-sum stochastic differential games where each of 
the both players has his own terminal as well as running cost functionals &j and fj, respectively, 
j = 1,2. More precisely, for arbitrarily given admissible controls u(-) E W and v(-) G V, we 
consider the following BSDEs, j = 1,2, 

m J s 

rT 

- I iZ$t™°dB r , t<s<T, 

J s 

where X t ^' ,u,v is introduced by equation (3.1) and 
$ j = ^(x) : R n R 5 

fj = fj(t, x, y, z, u, v) :[0,T]xM"xRxR' i xf/xl/4 R, 

are assumed to satisfy the conditions (H3.3) and (H3A). In addition, in order to simplify the 
arguments, we also suppose that 

(H3.5) §j and fj, j = 1,2, are bounded. 

The associated stochastic backward semigroups are denoted by ^G l ~,t < s < T,j = 1,2, 
and for the associated cost functionals Jj(t, x;u,v) = 0Y t ' x ' v,v , we have 

M' ■■•■■■».<■) = iGi^&jix^)] = >G\^rn t %7' v ] 

(t,x) G [0,T] x R n , (u,v) eU t , T x V t ,T,0 < 5 <T-t,j = 1,2. 

For what follows we assume that the Isaacs condition holds in the following sense: For all 
(t, x, y,p) G [0, T] x 1" x 1 x R n and A G S n (Recall that §" denotes the set ofnxn symmetric 
matrices) and for j = 1,2, we have 

sup inf | -tr(aa T (t, x, u, v)A) + (p, b(t, x, u, v)) + fj(t, x, y,p T o~(t, x, u, v),u, v)\ 

f l ( 3 - 3 ) 
= inf sup \ -tr(aa T (t, x, u, v)A) + (p, b(t, x, u, v)) + fj(t, x, y,p T a(t, x, u, v),u, v) > . 
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Under the Isaacs condition (3.3) we have, similar to [2], 



W\(t,x) = esssup essinf J\(t, x; a, (3) = essinf esssup Ji(t, x; a, f3), 



and 



W2(t, x) = essinf esssup J2(t, x; a, j3) = esssup essinf J2(t, x; a, (3), (3-4) 

aeAt.r /SeB tlT P£B t ,T a&A t,T 

(t,x) £ [0,T] x W l . 



Finally, we complete the preparation with the definition of the Nash equilibrium payoff 
of stochastic differential games, which is similar to the definition introduced by Buckdahn, 
Cardaliaguet and Rainer [3]. 

Definition 3.13 A couple (e±,e2) £ K 2 is called a Nash equilibrium payoff at the point (t,x) if 
for any e > 0, there exists (a e ,/3 e ) £ At,T X £>t,T such that, for all (a,/3) € At,r x &t,T-, 

Ji(t,x;a £ ,(3 £ ) > Ji(t,x;a,f3 e ) - e, J 2 (t, x; a £ , /3 e ) > J 2 (t, x; a e , (5) - e, F - a.s., (3.5) 

and 

\E[Jj(t,x;a e ,p e )] -ej\< e, j = 1,2. 

Remark 3.14 We attract the reader's attention to the fact that Jj(t,x;a,/3),j = 1,2, are 
random variables. In our existence result (Theorem 3.20) we will construct cost functionals 
Jj(t,x;a e , f3 £ ),e > 0,j = 1,2, which are deterministic. 

By virtue of Lemma 3.5 we can easily get the following lemma. 

Lemma 3.15 For any e > and (a £ ,(3 £ ) € At,T x &t,T, (3-5) holds if and only if, for all 
(u, v) £ U t ,T X V t ,T, 

Ji(t,x;a e ,/3 £ ) > Ji(t,x;u,p e (u)) - e, J 2 (t, x; a £ , /3 £ ) > J 2 (t, x; a £ (v), v) - s, P - a.s. (3.6) 

We now give the characterization theorem of Nash equilibrium payoffs for nonzero-sum 
stochastic differential games. 

Theorem 3.16 Let (t,x) € [0,T] x W 1 . Under Isaacs condition (3.3), (e 1 ,e 2 ) G M 2 is a Nash 
equilibrium payoff at point (t,x) if and only if for all e > 0, there exist (u £ ,v £ ) £ Ut,T x Vt,T 
such that for all s £ [t,T] and j = 1,2, 



t,x:u e ,v e 



> Wj(s,X 



t,x:u e ,ti £ 



) -e | T% > 1 



a.s., 



(3.7) 



and 



\E[J j (t,x;u £ ,v E )]-e j \<e. (3.8) 

Remark 3.17 The above Theorem generalizes the results of [3] and [18] from the case of clas- 
sical cost functionals without running costs to nonlinear cost functionals which running cost 
fj,j = 1,2, depend on (y,z). Moreover, in our framework the controls can depend on events 
occurring before time t. 
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We prepare the proof of this Theorem by the following two lemmas. 

Lemma 3.18 Let (t,x) G [0,T] x M n and u G Ut,T be arbitrarily fixed. Then, 

(i) for all 5 £ [0, T — t] and e > 0, there exists an NAD strategy a G At,T such that, for all 

v G V t ,T, 

a(v) = u, on [t, t + 5], 
(uj /or aZZ 5 € [0, T — i] and e > 0, i/iere exists an NAD strategy a G -4.t,T swc/i that, for all 

V G V t ,T, 

a(v) = u, on [t, t + 5], 

Proof: We only give the proof of (i). Indeed, (ii) can be proved by a symmetric argument. 
We begin with observing that putting j3 v (v!) = v', for all v! G U t +s,Ti defines for every v' G Vt+s,T 
an element j3 v G Bt+s,T and allows to regard Vt+^T as a subset of Bt+s,T- Consequently, from 
(3.4), for any y G M. n , we have 

W2(t + S, y) = essinf esssup J^{t + 5, y; a, jS) 

aeA t+s ,T (3£B t+s ,T 

> essinf esssup J2H + S, y; a(v), v), P — a.s. 
aeA t+ s,T veV t+S}T 

Therefore, for Eo > 0, there exists a y G At+s,T such that 

W2(t + S,y) > esssup J2(t + 5, y; a y (v), v) — eo, P — a.s. (3.9) 

veV t+StT 

(The existence of a y G At+s,T can be shown with the techniques used in the proof of Lemma 
3.8 in Buckdahn and Li [4]). 

Let {Oi}i>i C B(R n ) be a partition of R n such that £ O; = R n ,Oi / 0, and diam(0;) < 

i>i 

Eo,i > 1. Let G Oj,i > 1. We put, for i> G Vj 5 t, 



a(w) ; 



(3.10) 



n s , s G [M + 5], 

!C 1 {x t t ^ 11 '"GO ! } a w(' t; l[t+'5,r])si s G (t + 5,T]. 
The such introduced mapping a : V^t —> Ut,T is an NAD strategy. Indeed, 

(i) The mapping a is nonanticipative. Proof: For every (7>)-stopping time r : O — ¥ [t,T], 
and for v±,V2 G Vt,T with v\ = V2 on [[i, r]], we decompose ui,U2 into v\,v\ G V^t+a and 
G Vt+^T such that = v\ on [i, i + 6], and = V{ on [i + (5, T],i = 1,2. In order to 
abbreviate, we will write for this: v\ = v\ © and ^2 = v\ ffi u|. Then we have = v| on 
[[t, rA(t+6)]] and i>f = v\ on [[r A(i+6"), r]]. It is obvious that a{v\) = u = a (1*2) on [t, t+5] and, 

hence, also on [[t,r A(t + S)}}. Since uj = v\ on [[i, r A (t + 5)}}, we have x*^^'^ = x^f^'^ 
on {r > t + 5}, P — a.s. Therefore, because of the nonanticipativity of a yi ,i > 1, 

= 2 ^'■^("il.'Ln "^(^i 2 ) = 1 rv t '-' a («a)'"i c n = «(U2) 

j>! l A t+i ec, i> j>! i x t+s &<J it 
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on [[t A (t + S),t]]. 

(ii) The mapping a is a nonanticipative strategy with delay. Proof: For v = v 1 © v 2 G 
Vt,t+5 x V t +s,T, we have 



a(v) = u © 1 {x t, X ;u,^ e0 . } a yi (v 2 ). 

Let {5'^(u 2 )} n >i be the sequence of the stopping times associated with a Vi € At+s,T in the sense 
of the Definition 3.4. Then, putting Sq = t, Si = t + 5, 



Sn+l(v) = ^ 1 {X t t 'Y' vl eO i } S%n ^ ,n ~ 1 - 



i>l 



We have that {S n (v)} n >i satisfies the condition 2) in Definition 3.4. Thus, a is a nonanticipative 
strategy with delay. 

From Lemma 3.9, (3.9) and (3.10) it follows that, for v G Vt t, 

W 2 {t + 5,X t ' +5 ) 

i>l t+ 



> X! 1 {x t ' a;;c,w ^eo 1 } j2 ^ + ' 5 ' yi;a ^^l[*+' 5 ' T ^' ?; ) ~ Ce o 

i>l 1+5 

= Y^ {x t.^Mv)^ (i0 ^J2{t + 5,yi-a{v),v) - Ce . 



'■t+s 

i>i 



Thus, from Proposition 3.2, 

i>l 

= J 2 (t + S,X^ v) ' v ;a(v),v)-Ce . 

Here C is a constant which can vary from line to line, but which is independent of v G Vt t- 
Putting eo = eC 1-1 in the latter estimate, we obtain 

W 2 (t + 6, xX 5 a{v) n > Ut + 5, X%f^-a{v),v) - e, v G V t , T . 
The proof is complete. □ 

The proof of Theorem 3.16 necessitates the following lemma. 

Lemma 3.19 There exists a positive constant C such that, for all (u,v), (u',v') G Ut,T x Vt,T, 
and for all J- r -stopping times S : Q, — > [t, T] with Xg X ' u ' v = Xg X ' u ' v , P — a.s., it holds, for all 
real r G [t, T], 

icr I vt,x;u,v v t,x;u',v' |2 t 1 ^ n m 

E[ sup |X (s+s)AT - X {s+s ) A t\ ?t\ <Ct, P - a.s. 
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This lemma is the result of a straight forward estimate using the fact that b and a are bounded. 



Let us give now the proof of Theorem 3.16. 

Proof of Theorem 3.16: Sufficiency of (3.7) and (3.8). 

Proof: Let e > be arbitrarily fixed. For eq > being specified later we suppose that 
(u £o ,v eo ) G U t , T x V t , T satisfies (3.7) and (3.8), i.e., for all s G [t,T] and j = 1,2, 

p( iY*' x ' ue °' ve ° > Wjis^Xi^ ^ ) -e Q | Ft) > l-e , P-a.s., (3.11) 

and 

lEtJj-^x;!* 60 ,^ )] — e,-| <e - (3.12) 

Let us fix some partition: t = to < t± < • • • < t m = T of [t, T] and r = sup |tj — We apply 

Lemma 3.18 to u £0 and i + 5 = t±, ■ ■ ■ , t m , successively. Then, for E\ > (ei depends on e and 
is specified later) there exist NAD strategies on G »4f,T, i = 1, • • • , m, such that, for all t> G V^t, 

cti(v) = u £ °,on [t,U], 
2 Y gz-Mv),v < Wa^^^^J + ei, P-a.s. (3.13) 

For all v G V^t, we define 

S v = inf js > t | A({r G [t, s] : « r / v £ °}) > o}, 
= inf {k> S v \i = !,-■■ , ?n} A T, 

where A denotes the Lebesgue measure on the real line P. Obviously, S v and V are stopping 
times, and we have S° < t v < S v + r. 
Let 

on [[Ml], 

a £ {v) = < 

[ Oi(v), on (ti,T\ x {t v = U},1 < i < m. 
It is easy to check that a £ is an NAD strategy. From (3.13) it follows that 

m 

2 v t,x;a e (v),v 2 v t,x;a e (v),v 

Y tv - 2^ Y u l {t v =k} 

i=i 

m 

i=i 

= W 2 {t v ,X t t f' as{v) ' v )+e 1 , P-a.s. (3.14) 
In what follows we will show that, for all e > and v G Vt,T, 

J 2 (t,x;a e (v),v) < J 2 (t,x;u £0 ,v £0 ) + e, a e (v £0 ) = u £0 . (3.15) 
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This relation as well as the symmetric one for J\ will lead to the sufficiency of (3.7) and (3.8). 
For the proof of (3.15), we note that by (3.14), Lemma 2.2 and Lemma 2.3 there exists a positive 
constant C such that 

J 2 (t,X,a e (v),v) = 2 G t,x,a^), V[ 2 Y t, X ,a £ (v)^ 

< 2 G\^ {v) ^[W 2 {t v ) X t t f^ {v) ' v )+e 1 ] 

< 2 Gf t ^ {v) ' l \W 2 {t\x\f^ v) ' v )] + Ce l . (3.16) 

Thanks to the Lemmas 3.9 and 3.19 as well as the definitions of t v and a e we have 

n\W2{t\X% x ' ue °' ve °) - W 2 {t v 1 X t t f^ v )\ 2 \F t ] 

< CE[|X^ ;wS0 ' uS ° - x\f' a ^ v \ 2 Ft] 

< Ct, F-a.s. 

Thus, from Lemma 2.3 it follows that 

| *tf$*W> v [W 2 (t\Xtf'' u ^)] - 2 G t ^ {v) > v [W 2 {t\x\?^ {v) > v )]\ 

< CE[\W 2 (t v ,xlf' ueo ' ve °) - W 2 (t v ,xlf ' as[v) ' v )\ 2 \T t } 1 2 

< Cr3, 

and the above inequality and (3.16) yield 

J 2 (t,x,a £ (v),v) 

< G ttt v [W 2 {t ,X tv )\- Lr tjt v [W 2 {t ,X tv )\\ 
+ | 2 Gl'^ {v) > v [W 2 (t v ,Xtf-' uE0 ' v£ °)}+Ce 1 

< 2 Glp a ^ v [W 2 (t\X t t f' uS °' v£ °)] + Ce 1 + cA. 

For s € [t, T], we put 



2yt, X ;u°o,v° > w 2 (s,Xl^ ueo ' veo ) - eo }. 

By the inequality a < b + |a — 6|, a, 6 G R, we have 
J 2 (t,a;;a 6 (u),t;) 

m 



< 



i=i 
m 



< a G^^E^(ti,^' ^)l { ^ } lo t( ] + C ei + C'Ti 

i=l 

m 

+rc ,w, "E^ x r N,B,,l ) i {*'=t.}] 
t=i 

-^•*W' tf E^(<i,4" !U '° , ^)V=**} 1 n* l ]l- (3-17) 



i=l 
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Using Lemma 2.3 again as well as the boundedness of W2, we see that 

m 



8=1 

m 



{V) ' V [J2 W 2 (*i > Xt t?'' US ° ' VS ° ) \V> =U} K ] I 
i=l 

m 

i=i 

m 

< Cj^¥(n c ti \T t )^ <Cmel (3.18) 



i=l 

where we have used (3.11) for the latter estimate. Observing that 

Y t ! ' >W 2 {ti,X t y )-e , onfi ti , 

we deduce from the Lemmas 2.2 and 2.3 that 

m 

W,t« [z^^ 2 ^'^ )l{^= tl }ln t 



- G t,v izJ. Y u + e oJl{t"=t ! }ln t J 

i=l 
m 

i=l 
m 

i=l 

Hence, taking into account Zy^'M 1 ')," _ zyMftW.'^ ( an( j that, j n analogy to (3.18) 

i=l 

m m 
I 2^i^;aE(»)i" [V^ 2-i^t,x;u e O,u £ o , 2 / ^t<,a;;c« £ (i'),^ rV^ 2-i^i,£;a e ('u),t> i 



{t*=ti] 

i=l i=l 



we see that 

2 / ^,t,a:;a e (u),i>rV _ ^ Tir /. v t,x;u e O ,V e \-. n 

G t,t« Iz^^ 2 ^'^ )i{^-=t l }in t 

1=1 



< 2 G*;^ ae(l ' ) ' ,; [ 2 y/j x;u£0 ' 1,£0 ] + Ce + Cmel 

I 2 /~it,x;a E (v),v r 2\^i,a;;'i' eo ,i ,£ ° 1 2^<t,x;u e ,v e r 2 v t,x;u e ,v e ■, 
— I W,t" i *t v I ~ ^t,t° l *t v I 

I 2 fit,X',oi e (y),v r 2\rt,x;u E y v e 2{~tt,x;u e : v e r 2-i^t,^;« E ° ,f e ° l 

+ J 2 (t, x; n eo , ^ eo ) + Ce + Cme| . 
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In the frame of the proof of (3.15) we also need the following estimate 

In order to verify this relation we let, for all s S 

and we consider the BSDE solved by y = (y s ) 

Vs = 2yW,^ + I* h (r,Xl^^\y r ,z r ,a £ {v r ),v r )dr- f z r dB r 

J s J s 

as well as 



- / 2 Z t r ' x ' u ' v0 dB r ,se [Ml 

J s 



We notice that a e (v) = u £ °, on [[M^]], v = v £ ° , on [[£,5^]]. (Of course, these equalities, in 
particular, the latter one, are understood as dsdF — a.e.) Thanks to Lemma 2.3 we have 

< CE[ / l/zCr,^^^,^,^,^^),.,^) - f2(r,X^ ue °> ve \y r ,z r ,u?,v s r °)\ 2 dr\T t ] 



+CE[[ t [/ 2 (r,^*M'^ r ,*,a 6 (t;)^ 
Js v 

= CE[f \f2(r,X t * a <M> v ,y r ,z r ,a e (v) r ,v r ) - f2{r,X^°^° ,y ri z r ,u £ r \v?)\ 2 dr\F t \ 
< CE[t \ {Vr ^ } dr\T t ]<CW ~ S l '\T t ]<Cr. 

J S v 

Therefore, we have 

m 

2 (^^^W2it l ,X^^^)l^ =t ^ 

i=l 

< CA + J 2 {t,x;u £0 ,v £0 ) + Ce + Cme^, 
and (3.17), (3.18) as well as the above inequality yield 

i i 

J2(t,x;a £ (v),v) < J 2 (t,x;n £0 ,f eo ) + Ce + Cme§ + Ce\ + Cra. 

I i 

We can choose r > 0, Eq > 0, and e\ > such that Ceo + CuiEq + Cei + CV2 < g and £o < e. 
Thus, 

J 2 (i,x;a £ (v),v) < J 2 (i, x; ii £ °, i; eo ) + e, u € V t , T . 
By a symmetric argument we can construct /3 e E £>i,T such that, for all u € Ut,T, 

Ji(t,x;u,p e (u)) < Ji(t,x;u £0 ,v £0 )+e, (3 e (u £0 ) = v £0 . (3.19) 
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Finally, by virtue of (3.15), (3.19), (3.12) and Lemma 3.15 we can see that (a E ,(3 E ) satisfies 
Definition 3.13. Therefore, (ei,e2) is a Nash equilibrium payoff. □ 



Proof of Theorem 3.16: Necessity of (3.7) and (3. 



Proof: We assume that (ei,e2) G M? is a Nash equilibrium payoff at the point (t, x). 
Then, for all sufficiently small e > 0, there exists (a £ ,f3 £ ) G At,T x Bt.T such that, for all 
(a, p) G A,T x B t ,T 



Ji(t,x;a £ ,/3 e ) > Ji(t,x;a,p E ) -e 4 , J 2 (t,x;a e , f3 e ) > J 2 (t, x; a £ , j3) - e 4 ,P - a.s., (3.20) 



and 



\E[J J (t,x;a e ,f3 e )]-e j \<e\ j = 1,2. (3.21) 

Moreover, from Lemma 3.5 we know that there exists a unique couple (u £ ,v £ ) such that 

a £ (v £ ) = u £ ,(3 £ (u £ ) = v £ . 

Let us argue by contradiction. For this we observe that (3.21) means that (3.8) holds. Assuming 
that (3.7) doesn't hold true, we have, for all e' > 0, the existence of some e G (0, e') (for which 
we use the notations introduced above) and 5 G [0, T — t] such that, for some j G {1, 2}, say for 

i = i, 



e I Ft) > e) > 



Put 



A = { %%T e ^ <W 1 (t + 5, Xgf>") - e } G F t+S . 



(3.22) 



(3.23) 



By applying Lemma 3.18 to u £ and t + 5 we see that, there exists an NAD strategy a G -4t,T) 
such that, for all v G VtTi 



a(v) = u £ , on [t, t + 5], 



lyt,i;a(t)),u 



> ^i(t + 5,x;;^' 



t,a:;a(i;),?j \ 



a.s. 



(3.24) 



t+S — 1 -7-- t+() / 2' 

By virtue of Lemma 3.5 there exists a unique couple (n, u) G Ut,T x Vt,r such that 

a(v) = u, (3 £ (u) = v. 

We observe that this, in particular, means that u = u £ on [t, t + <5]. Let us define now a control 
u G t as follows: 



u = < 



w e , on ([i,( + i)xfi)U([t + J,T]x4 
u, on [t + 5,T] x ,4. 



Since f3 e G Bjt is nonanticipative it follows that /3 e (u) = fl £ (u £ ) = v £ on [t,t + 8], and for all 
s G [t + o,T], ' 



/3 £ (S), 



Pe{u)s = v s , on A, 
f3 £ (u £ ) s = v £ , on A c . 
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Then we have 

x t,x;u,p E (u) = x*w e ,* t on [ tj t + 5], 

x t,xMv),v^ on [ t + s,T]x A, 
x t,x;u E ,v^ on [t + S,T] x A c , 
and standard arguments show that also 



x t,x;u,f3 s (u) 



l v t,x;u,p £ (u) 
I t+S 



i Y !:T iv) ' v , on A, 



t+S 

yt,x;i 
t+S 



ly t X,U E ,V E QnA c^ 



Therefore, 



Ji(t,x;u,P e (u)) 



T t,t+5 L 1 t+S 



ly > > iqi 

\ Qt,x\u,f3 £ (u) ^\ v t,x\u,f3ir(u) -| ! l v t,x;u,/3 s (u) 



t,t+5 



L Y 



t+S 



'1a+ a K 



t+5 



1a c 



Thanks to Lemma 2.2 and (3.24) we have 



Ji{t,x;u,(3 £ {u)) v* tt _ 



1 Qt,x\u,f3 E (u) i~l-yt,x;a(v),v 



Y, 



t+5 



'1 i lvt,x;u e ,v £ -. 

1a + y t+s lA 



1 „t,x;u,/3 e (u) r TJ/ / 

(* ttt+s [Wi{t + d,x t+s )i A + y t+5 l-Ac-^M- 

Hence, from (3.23) it follows that 

Ji(t,z;u,&(S)) > 1 GjS AW [^i(* + tf,Xa fU " ,B *)U+ 1 Y%F>"1a—\U 



A,x\u E ,v E 



±-</-t,x;u s ,v E 



l^-,t,a;;u,/3 e (u) r\ v t,x;u E ,v E e 



t,t+<S L 2 t+5 



+ 2 U] 



+ 2 U] - 



(3.25) 



Let 



G' t+5 ' [ Y t ^ +-lA\,se[t,t + 8\. 



This process is the solution of the following BSDE: 

-t+5 



\-trt,x;u e ,v E . £ -, 

Vs = Y t+s +2 U + 

rt+S 



/i (r, X*' x ' u ' v ,y r ,z r ,u £ r , v £ r )dr 
s € [t,t + S], 



which we compare with 



lyt,X\U E ,V E 



lyt,X;U E ,V E 



t+S 



rt+d 

+ / /i(r,X*^" £ ^, lyM;^ x Z^ uS ' ve ,u e r ,v £ r )dr 
t+S s 

J 1 Z^ ue ' ve dB r , se[t,t + S}. 
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Putting 

y s =y s - 1 Y s t ^ s > vS ,z s = z s - ^Z^^, se[t,t + 6], 

we have 

rt+S 
J s 

rt+S 

+-U- / z r dB r , se[t,t + d). (3.26) 



For notational simplification let us assume that the Brownian motion B is one dimensional, and 
we introduce, for r £ [i, t + 5], 

a, = l {f ^ 0} (yJ" 1 (/ 1 (r,^ £ ^^y r ,z r ,<,^) -/i^X^^, z r , <, <)) , 

6 r = l { ^ } (Z r )- 1 (/ 1 (r,A^*' t ' e , 1 Y^ l ^,z ri -4y r ) 

Then, from the Lipschitz property of /i we see that \a r \ < L, [6 r | < L,r € [t, i + <5] , and BSDE 
(3.26) takes the following form: 

e rt+S rt+S 

y s = i^a+ / [a r y r + b r z r ]dr - z r dB r , s G [t, i + 6]. 

J S J S 

By putting 

Q s =exp(^J^ a r dr + J b r dB r — — J |& r | 2 <ir^ , s € [t, t + 6], 
applying Ito's formula to y s Q s , and then taking the conditional expectation, we deduce that 

y t = £ -niAQt+5 \?t]- 



By the Schwarz inequality we have 

. i t*.i^2 <<■ urn . /n . _ i ir.iwrr. 



(^|J- t ) 2 = (E[U|Ji]) 2 < E[UQt+a \?tW)Zh \H- 



We observe that 

"t+S rt+S i 



, rt+o rt+o ^ rt+o 

HQt+S \?t] = E[exp(-y a r dr-J b r dB r + - J \b r \ 2 dr) \ JF t ] 

. rt+S i rt+S . 

< exp(L5 + L 2 5)E[exp ^ - jf b r dB r - - J \b r \ 2 drj \ T t ] 



= exp(L5 + L 2 6). 

Let 



A = {P( < Wi(t + <5, xg^) - e | Ji) > e} ( = {P(^) > e] 

Then, 



& = |E[UQ m \F t \ 
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> * M ~ L5 - LH)£ (nun? = eM ~ L5 ~ LH)£ {nA\T t) f 



2 



e 3 



> yCoU, (3.27) 
for Co = exp(— L5 — L 2 5), where we use (3.22) in the last inequality. Combining (3.27) with 
Vt-Vt- Y t - U t,t+8 I Y t+5 +2 l A\- <^ t ,t+S I Y t+8 J' 



we have 



F P 3 
\ z~it,x\u E ai e rl-,A,x;u E ,v E i -i i . \ ^t,X\U E ,V E rl-trt,X;U E ,V E -\ i s y -i 

G t>t+S [Y t+5 +2 1 ^ > G *,i+-5 I Y t+s J + Y^oU, 



and (3.25) then yields 



s 3 



Ji(t,x;u,(3 e (u)) > Ji(t,x;a £ ,/3 £ ) + yColA- 



e' 3 

We can choose e' € (0, 1) sufficiently small such that y~Co > £ ' 4 (Recall that e' > has been 

introduced at the beginning of the proof, assuming that (3.7) doesn't hold true). Then this rela- 

e 3 

tion is also satisfied by e G (0,e') : "yCo > £ 4 - Since P(A) > 0, the above inequality contradicts 
with (3.20) for a(-) = u. The proof is complete. □ 

We now give the existence theorem of a Nash equilibrium payoff. 

Theorem 3.20 Let the Isaacs condition (3.3) hold. Then for all (t,x) G [0,T] xl", there exists 
a Nash equilibrium payoff at (t, x). 

Let us admit the following Proposition for the moment. We shall give its proof after. 

Proposition 3.21 Under the assumptions of Theorem 3.16, for all e > 0, there exists (u £ ,v £ ) £ 
Ut,T x Vt.T independent of Ft such that, for all t < si < S2 < T, j = 1, 2, 

' WjisuXtf^^) - e < •'• ;U> 2 ..V; : ;' : " •'• )]) > 1 -e. 

Let us begin with the proof of Theorem 3.20. 

Proof: By Theorem 3.16 we only have to prove that, for all e > 0, there exists (u e ,v e ) G 
Ut,T x Vt.T which satisfies (3.7) and (3.8) for s G [t,T],j = 1,2. 

For e > 0, we consider (u £ ,v £ ) G Ut t T x Vt,T given by Proposition 3.21, i.e., in particular, 
(u £ ,v £ ) is independent of Ft, and we put s\ = s, S2 = T in Proposition 3.21. This yields (3.7). We 
also observe that the fact that (u £ ,v £ ) is independent of Ft implies that Jj(t,x;u £ ,v £ ),j = 1,2, 

are deterministic and j(Ji(i, x; u £ , v £ ), J%{t, x; u £ , v 6 )), e > o| is a bounded sequence. Conse- 
quently, we can choose an accumulation point of this sequence, as e — > 0. Let us denote this 
point by (ei,e2). Obviously, this combined with (3.7) allows to conclude from Theorem 3.16 
that (ei,e2) is a Nash equilibrium payoff at (t, x). We also refer to the fact that since (u £ ,v £ ) 
is independent of Ft, the conditional probability ¥(-\Ft) of the event 

J 'Gs^s2 \Wj{s2 1 X t s f' u ' v )]| coincides with its probability. Indeed, also ^Wj(si,Xlf' u ' v ) — 
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e < ^Gaf/sa ,V [Wj(s2,Xtf' u ' v )]| is independent of T t . The proof is complete. □ 

Before we present the proof of the above Proposition, we give the following Lemmas, which 
will be needed. 

Lemma 3.22 For all e > 0, and all 5 G [0, T — t] and x G M. n , there exists (u e ,v e ) G U ti T x Vt,T 
independent of Tt, such that 

W 1 (t,x)-e< 'Gl^iWiit + S^^f'*)), P-«. S ., 

and 

W 2 (t,x)-e< 2 Gf t f s ^[W 2 {t + 5,X^f^)l F-a.s. 

Proof: Let F* = {J^) s ^[t t T\ denote the filtration generated by (B s — B t ) s& y t ^ and augmented 
by the P-null sets. By IA\ T (resp., V* T ) we denote the set of F*-adapted processes {"Ur}re[s,T] 
(resp., {v r } r £[ Sj T]) taking their values in U (resp., V). Moreover, let A^ T (resp., B* T ) denote 
the set of NAD strategies which map from V* T into U l sT (resp. U\ T into V* T ). With this 
setting we replace the framework of SDEs driven by a Brownian motion B = (-B s ) s e[o,Ti by that 
of SDEs driven by a Brownian motion (B s — #t) s e[t,T]- We also translate the above arguments 
from the framework of SDEs to the associated BSDEs. Then, proceeding in the same manner 
as above, but now in our new framework, we have the Isaacs condition, for j = 1, 2, s £ [t, T], 

sup inf \^-tr(aa T (s, x, u, v)A) + (p, b(s, x, u, v)) + fj(s, x, y,p T a(s, x, u, v),u, v)\ 

= inf sup { -tr(aa T (s, x, u, v)A) + {p, b(s, x, u, v)) + fj(s, x, y,p T a(s, x, u, v),u, v)\ 

for the associated value functionals 

W\(s, x) = esssup essinf J\(s, x; a, f3) = essinf esssup Ji(s, x; a, (3), 
aeA\ iT /3eB* iT /3eS*_ T a &A* iT 

and 

W2(s, x) = essinf esssup J 2 (s, x; a, f3) = esssup essinf J 2 (s, x; a, (3), 
(s,x) G [t,T] x R n . 

For j = 1,2, from [2] we know that Wj restricted to [t,T] x R n and Wj are inside the class 
of continuous functions with at most polynomial growth and the unique viscosity solutions of 
the same Hamilton-Jacobi-Bellman-Isaacs equation. Consequently, they coincide 

Wj(s,x) = Wj(s,x), (s,x) G [t,T] x R n , j = 1,2. 
From the dynamic programming principle for Wj and by observing that V\ T c B\ T we have 
Wi (t, x) = W x (t, x) = esssup essinf l G t ; x i ^f [Wi (t + 5, X^ a ' P )] 

< esssupessinf x C^ v)i °[W x {t + 5, X^f^)]. 
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Consequently, for e > and 5 > 0, there exists a e € A\ T such that, for all v € V\ T , 

Wi(*,s)-e< ^"/^^^(t + ^X^^)], F-a.s. 
The symmetric argument allows to show that the existence of j3 £ £ B\ T such that, for all u £W ( 'j., 

W 2 (t, x)-e< 2 G^; M / £(U) [W 2 (t + 5, xffi&M)], P - a.s. 
In the same way as shown in Lemma 3.5, we get the existence of (u £ ,v £ ) £ U\ T xV^ T such that 

a £ (v £ ) = u £ ,(3 e (u £ ) = v £ . 

Therefore, we have 

W 1 (t, x)-e< l G%f^ [W x {t + 5, X%f>*)], 

and 

W 2 (t, x)-e< 2 G 1 ^ [W 2 (t + 5, X^f^)]. 

The proof is complete. □ 

We also need the following Lemma. 

Lemma 3.23 Let n > 1 and let us fix some partition t = to < t± < • • • < t n = T of the interval 
[t,T]. Then, for all e > 0, there exists (u £ ,v £ ) 6 Ut,T x Vt,T independent of Ft, such that, for all 
i = 0, • • ■ ,n — l, 

W 1 (t i ,X t t f^' vS )-e< ^XflWi^X^f'^)], F-a.s., 

and 

Wife,^: )-£< G t 'j. + i [w 2 {t i+ll x t i^ )], P-o.s. 

Proof: We shall give the proof by induction. By the above lemma, it is obvious for i = 0. 
We now assume that (u £ ,v £ ) independent of Ft, is constructed on the interval [t,U) and we 
shall define it on From the above lemma it follows that, for all y € M n , there exists 

(u y ,v v ) € Ut u T x V*j,T independent of Ft, such that, 

W 3 {U,y)- £ -< j G^f[W^X^f' vV )\, ¥-a.s,j = 1,2. (3.28) 
Let us fix arbitrarily j = 1, 2. Moreover, for y,z £ W 1 and s E [ti, ti+i], we put 

ys= 3 G:;^ x ' [WjiU+uX^; )], and y s = J G*J t .' +1 [WjiU+^X^; )], 
and we consider the BSDEs: 

z\dB r , s G 
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and 



yl = W J (t l+1 ,X^^) + 
rU+i 



P*i+1 



- / z r dB r , s G [U,t i+ i]. 

J s 

By virtue of the Lemmas 2.3, 3.1 and 3.9 we have 



ti, z;u y ,v v \i\2 
U+i )\\ 



< CE[|^-(t i+1 ,X*; 



t,y;u y ,v y < 
+ 1 



^•(^ + i,4rr^)i 2 



+CE[| / f j {r,X!*>w>'>'> v ,y},4,v?,vV)dr- / / i (r,^^^,y r 1 ,z r 1 ,<,^)dr| 2 Ji] 



— LI t i+1 I 



Ji] + CE[ ^^"■« B - X^ z ' uV ' vV \ 2 dr F t ] 
hi 



< C\y-z\ 2 . 

Therefore, by the above inequality, Lemma 3.9 and (3.28) 



< 


Wj(ti,y) 


-e + C\y- 


- z\ 




< 


jQti,y;u v 


vV [Wj(t l+1 


v U,y;u y ,v y \i 
X U +1 )\ ~ 


\ + C\y-z 


< 


jQt i: z;u y 
ti,ti+l 


vV [Wj(t i+1 


x u +1 )\ - 


l + C\y-z 


< 


jQti,z;u y 
ti,ti+l 


vV [Wj(t i+1 




*-a.a., 



for C\y - z\ < -. 

Let {Oi}i>i C B(R n ) be a partition of W n with diam(Oi) < ^— and let y { € X . Then, for 

zeo h 



r ti,z;u y l,v y l 



i + l 



)], 



a.s., 



(3.29) 



and we define 



l oA x u 



,,<// 



Therefore, we have 



"i jt-j-f-l 



t,x\u ,-u g g 



i>i 



:u y l,v y l 



)i 0l {xtr e ' ve )] 



■u y l ,v y l ,j _..,,£ ,,e 
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The latter relation follows from the uniqueness of solutions of BSDEs. From (3.29) it follows 
that 



= Y. W ^ X ^ UVl ' VVl ) l oAX t tr ue ' v£ )-e 
i>i 

The proof is complete. □ 
Finally, we give the proof of Proposition 3.21. 

Proof: Let t = to < tl < ■ ■ ■ < t n = T be a partition of [t, T], and r = sup(tj+i — U). From 

i 

Lemma 3.9 it follows that, for all j = 1, 2, < k < n, s G [i^, ifc+i) and (u, v) G U^t x Vt,T, 

< 2M[\ Wj (t k ,x t t ^) - w^xtrn?] 

+2E[\W j (s,xtf> u > v ) - W^X^)] 2 ] 

< C\s - t k \(l +E[|X*; W | 2 ]) + CE[\X^ x;u ' v - Xl' x ' u ' v \ 2 } 

< Ct. (3.30) 



Here and after C is a constant which may be different from line to line. 

By virtue of Lemma 3.23 we let (u £ , v e ) € litT x Vt t be defined as in Lemma 3.23 for e = £o, 
where £o > will be specified later. Then, we have for alH, < i < n, 

Wj{t h X ti ' ) -e < J G^ l i+ [ [WjiU+^X^ ■ )], F-a.s. 

For t < s\ < S2 < T, we suppose, without loss of generality, that t^— l < si < ti and % < S2 < 
tfc+i, for some l<i</c<n — 1. Therefore, by the Lemmas 2.2 and 2.3 we have 



> ^i^m^xif^-so} 



u,t i+ i \. w W+ii x t i+1 



and the above inequality yields 

j GTx:^ w At^xi^^)\ 

> ^^[Wji^Xlf^^) -C(k-i+ ljeo] 
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> [w^x^ ■« )]- C (k-i + i) £o 



where we put eo = „ • Let us put 
2Cn 



£ 

2' 



J 2 = + ^ (3.31) 



We assert that 

E[|/i-/ 2 | 2 ] <Cr. 

Indeed, setting 

Vs= j G^f^\W j (t i ,X^)\,se\s 1 ,t i \, 
we have the associated BSDEs: 

y s = W j (t i ,X t t f' ue ' ve )+ [ U f^X^^^Zr^v^dr 

J s 

z r dB r , s € [si, tj]. 

On the other hand, putting 

y'^W^xif^), s efoU], 

we have by Lemma 2.3 

+CE[[^f j (r,Xl' x ' uB ' ve ,y r ,z r , U E r ,v E r )\ 2 \T sl ]. 

Therefore, from the boundedness of fj and the independence of Tt of (u £ ,v £ ) 6 Ut,T x Vt,T, 
^G^^iWjituX}?^^)] - W^Xlf'^)^] 
< CEilWjfaXtf'*'*) ~ W^Xtf^^Ft] + C{U - si) 
= CnWj^X^^) - Wj{8 U X\f u£ ' vS )\ 2 } + C{U - 

From (3.30) it follows that 

nVGfX^lW^X^^)} - W^Xlf^^f] < Cr. (3.32) 
By a similar argument we have 

n^G^fiWjit^xl^f •«)] - Wj^Xif^)?} < Cr. (3.33) 
For s € [si, S2] we let 

vl= j G t ^f[w j {t k+11 x^' ve )]= J G^^yG^\w,(t k+1 ,xt^f^)]\, 
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and 

Vs - G S,S2 [ W j\ S ^ A S2 )u 

and we consider the associated BSDEs: 



J s 

z\dB r , s € [si,s 2 ], 



and 



/S2 

/S2 
z 2 r dB r , s G [si, s 2 ]. 

By virtue of the Lemmas 2.3 and 3.1 we have 

< cn j Gf 2 f^ mit^xt^)} - w 3 { S2 ,xi^^\f s1 \. 

Consequently, from (3.33) it follows that 

n\ ] GfX;l\W 3 {t k+1 ,xl^^)} - ^X^lW^Xlf^)]^] < Cr. 
By the above inequality and (3.32) we get 

E[|Ji -h?] < Ct. 

Consequently, 



m ,. r r . e. 4E[|Ii-J 2 | 2 l 4Cr 



where we choose r < — — , and from (3.31) it follows that 



> 1 - e. 



The proof is complete. □ 
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